How Good Is Crowd Post-Editing? Its Potential and Limitations
نویسندگان
چکیده
This paper is a partial report of a research effort on evaluating the effect of crowdsourced post-editing. We first discuss the emerging trend of crowd-sourced postediting of machine translation output, along with its benefits and drawbacks. Second, we describe the pilot study we have conducted on a platform that facilitates crowd-sourced post-editing. Finally, we provide our plans for further studies to have more insight on how effective crowdsourced post-editing is.
منابع مشابه
English to Hindi Translation Protocols for an Enterprise Crowd
We present early results on crowd sourcing translations in an enterprise setting. We show that several weak translators can together converge to translation quality higher than individually plausible. We share learning about post editing of translations and the effort perceived by the crowd. A key observation is that a protocol “machine-human-human” that utilizes two-hop post editing can provid...
متن کاملFeasibility of Post-Editing Speech Transcriptions with a Mismatched Crowd
Manual correction of speech transcription can involve a selection from plausible transcriptions. Recent work has shown the feasibility of employing a mismatched crowd for speech transcription. However, it is yet to be established whether a mismatched worker has sufficiently fine-granular speech perception to choose among the phonetically proximate options that are likely to be generated from th...
متن کاملA Data-driven Method for Crowd Simulation using a Holonification Model
In this paper, we present a data-driven method for crowd simulation with holonification model. With this extra module, the accuracy of simulation will increase and it generates more realistic behaviors of agents. First, we show how to use the concept of holon in crowd simulation and how effective it is. For this reason, we use simple rules for holonification. Using real-world data, we model the...
متن کاملDigital Art and Crowd Creation in Iran (Case Study: Tehran Annual Digital Art Exhibition)
This paper aims to show the status of digital art in Iran and explain how the meaning of an artist has transformed in the digital age. The primary assumption of this paper is that the experience of digital art has again revived the collective experience in creating arts. Although, interactivity is considered to be the most important quality of digital art, their collective, collaborative and pr...
متن کاملCrowd sculpting: A space-time sculpting method for populating virtual environments
We introduce "Crowd Sculpting": a method to interactively design populated environments by using intuitive deformation gestures to drive both the spatial coverage and the temporal sequencing of a crowd motion. Our approach assembles large environments from sets of spatial elements which contain inter-connectible, periodic crowd animations. Such a “Crowd Patches” approach allows us to avoid expe...
متن کامل